4. 



(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 
International Buieau 




(43) International Publication Date 
12 April 2001 (12.04.2001) 



PCT 



(10) International Publication Number 

WO 01/26379 Al 



(51) International Patent Classification^: H04N 7/24 

(21) International Application Number: PCTAJS00/276S7 

(22) International Filing Date: 6 October 2000 (06.10.2000) 

(25) Filing Language: English 

(26) Publication Language: English 



(30) Priority Data: 
60/158,190 



7 October 1999 (07.10.1999) US 



(71) Applicant: WORLD MULTICAST.COM, INC. 
[US/US]; 4125 Market Street. Suite 19, Ventura, CA 
93003 (US). 

(72) Inventor: STEWART, Ian, A.; 3378 FoothiUs Road, 
Carpintena, CA 93013 (US). 



(74) Agent: SMITH, Michael, S.; Black Lowe & Graham 
PLLC, 816 2nd Avenue, Seatde, WA 98104 (US). 

(81) Designated States (national)-. AE, AL, AM, AT, AU. AZ, 
BA, BB, BG, BR, BY, BZ, CA, CH, CN, CU, CZ, DE. DK, 
DZ, EE, ES, H, GB, GD, GE, GH, GM, HR, HU, ID, IL, 
IN, IS, JP, KE, KG, KP, KR, KZ, LC, LK, LR, LS, LT, LU, 
LV, MD, MG, MK, MN, MW. MX, MZ, NO. NZ, PL, FT, 
RO, RU, SD. SE. SG, SI, SK, SL, TJ, TM, TR, TT. UA, 
UG, UZ, VN, YU, ZA, ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE. LS, MW, MZ, SD. SL, SZ, TZ. UG, ZW), Eurasian 
patent (AM, AZ. BY, KG. KZ, MD, RU, TJ. TM), European 
patent (AT, BE, CH, CY. DE, DK, ES, H, FR, GB. GR, IE, 
IT, LU, MC, NL, FT, SE), OAPI patent (BF, BJ, CP, CG, 
CI, CM, GA, GN, GW, ML, MR. NE, SN, TD, TG). 

Published: 

— With international search report. 

[Continued on next page] 



(54) Title: SELF ADAPTING FRAME INTERVALS 



iECEIVE VIDEO 
STBEAM 



CN 



O 



'79 



TASEASAMnE 
OF A FRAME 
OF rmvmEO STREAM 



.72 



(57) Abstract: A computer processor implemented video compression 
method and computer program product (20) for automatically adjustiag frame 
interval during compression of a video signal. The method detennines a 
video motion value (22) from the video signal, detennines frame interval (24) 
according to the determined video motion vahie, and automatically adjusts 
the firame interval according to the detennined frame interval. 



COMFASErBESAM 
URENSAMPLESa 
VALUEOFCHANGl 
ACCORDING T0 1 


FUTOPREnOUSU 
mOETERMINEA 

? IN VIDEO MOTION 
HE COMPARISON 






DETERMINE mAUEtNTERVAL ^ 
^QUENCt)ACCORDim TO THE 
DETERMINED VALUE OF CHANGE 
IN VIDEO MOTION 



• 74 



'76 




PERFORMCOMPRESSIONOFTBE 
RECEIVED VIDEO IMA(S ACCORDING 
TO THERECEmYDETSRMlNED 
I-FRAMEINTERVAL 



BNSDCCID: <WO 0l2e379Al_L> 



wo 01/26379 Al IliilliillllliilllllliiliiiillHI 



For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



BNSDOCID: <WO ^0126379A1J_> 



wo 01/26379 



PCT/USOO/27687 



5 



SELF ADAPTING FRAME INTERVALS 



10 



FIELD OF THE INVENTION 



The present invention relates to video compression and, more particularly, to 
improving video compression quality. 



Although the Joint Photographic Experts Group (JPEG) compression standard 
is very effective at compressing streaming still images, further compression can be 
achieved using the Motion Picture Experts Group (MPEG) video standard. MPEG 
augments JPEG with motion compensation, a form of differential encoding, and 

20 achieves compression ratios as high as 200 to 1 . In MPEG, each frame in a video 
sequence is encoded. There are three kinds of MPEG video frames: intra (I), 
predictive (P), and bi-directional predicted (B). I-frames are independent of other 
frames, and their encoding is almost identical to JPEG. I-frames are encoded using 
information entirely within the frame-to-be compressed. P-frames are encoded using 

25 information both from within the frame-to-be compressed and from the previous I or 
P-frame. Compression is about 10 times better than for I-frames, but the performance 
costs are high. B-frames are encoded using information from within the frame, from 
the previous I or P-frame, and from the following I or P-frame. B-frames generally 
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are compressed to about one sixtieth the size of I-frames, but performance suffers 
even further. B-frames are never used as a basis for the encoding of other frames. 
The time it takes to decode each of the three frame types is roughly the same. 

Traditional video frame compression works great for talking heads. However, 
5 when the motion within a video becomes more dynamic the I-frame interval must be 
decreased in order to accommodate the higher motion. By decreasing the I-frame 
interval, the P and B-frames are based on more recently produced I-frames. 
Presently, adjusting the I-frame rate or interval is a time consuming trial and error, 
manually-perforaied process. The video compression in effect is less efficient, 
10 thereby making it more costly. Therefore, there exists a need for improving video 
compression by improving the ability to adjust I-frame rate. 

SUMMARY OF THE INVENTION 
The present invention provides a computer processor implemented video 

compression method and computer program product for compressing a video signal. 

The method determines a video motion value from the video signal, determines frame 

interval according to the determined video motion value, and compresses at least a 

portion of the video signal according to the determined frame interval. 

In accordance with further aspects of the invention, determining a video 

motion value includes taking a sample of a frame of the video signal, comparing the 

sample to one or more previously taken samples, and determining the video motion 

value according to the comparison. 

2 

BNSDCXJID: <WO 012e379A1_L> 



15 



20 



wo 01/26379 PCT/USOO/27687 

In accordance with other aspects of the invention, the steps of the process are 
repeated for frames of the video signal in accordance with a samphng pattern, such as 
every frame of the video signal. 

In accordance with still further aspects of the invention, determining frame 
5 interval further includes comparing the determined video motion value to one or more 
previously determined video motion values. If the determined video motion value 
differs from the one or more previously determined video motion values by a 
threshold amount, the method determines frame interval according to the determined 
video motion value. 

10 In accordance with yet other aspects of the invention, compressing at least a 

portion of the video signal according to the determined frame interval further includes 
comparing the frame interval to one or more previously determined frame intervals. 
- If the determined frame interval differs from the one or more previously determined 
frame intervals by a threshold amount, the method compresses at least a portion of 
15 the video signal according to the determined frame interval. 

In accordance with still other aspects of the invention, the frame interval is a 
predictive frame interval or a bi-directional predictive frame interval. 

In accordance with further aspects of the invention, compressing at least a 
portion of the video signal uses at least one of the MPEG compression schemes. 

20 
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BRIEF DESCRIPTION OF THE DRAWINGS 
The foregoing aspects and many of the attendant advantages of this invention 
will become more readily appreciated as the same becomes better imderstood by 
reference to the following detailed description, when taken in conjunction with the 
5 accompanying drawings, wherein: 

FIGURE 1 is a component diagram of the present invention; and 

FIGURES 2-4 are flow diagrams of embodiment processes performed by the 

components illustrated in FIGURE 1 . 

10 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

The invention provides automatically adapting intervals between I-frames 
during digital video compression, such as the Motion Pictures Experts Group 
(MPEG) compression schemes. As shown in FIGURE 1, a computer-based 
self-adapting compression processor 20 includes a motion sampler and determiner 

1 5 component 22 for receiving a framed video stream, an I-frame interval determiner 
component 24 coupled to the motion sampler and determiner component 22 and a 
video compressor component 26 coupled to the I-frame interval determiner 
component 24 for generating a compressed digital video. 

FIGURE 2 illustrates a first embodiment of the process performed by the 

20 components of FIGURE 1 . At block 40, the motion sampler and determiner 
component 22 receives a video stream from a video source. In one embodiment, the 
video stream is an analog video signal, such as NTSC or PAL. The video stream may 
be any other type of video signal, analog or digital, that includes firames of still 

4 
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images that require compression for storage or delivery. Next, at block 42, the 
motion sampler and determiner component 22 takes a sample of a frame of the 
received video stream. Then, at block 44, the motion sampler and determiner 
component 22 compares the sample to one or more previously taken samples and 
5 determines a value of change in video motion according to the comparison. The 
MPEG bitstream includes a motion vector and an error term. The error term is the 
same as the detemiined value of change in video motion. At block 46, the I-frame 
interval determiner component 24 determines an I-frame interval (frequency) 
according to the determined value of change in video motion. At block 48, the video 

10 compressor component 26 compresses the received video image according to the 
determined I-frame interval determination. The process returns to block 42 to take a 
sample of a successive frame, or of a frame at some interval in time or number of 
frames from the recently sampled frame. 

FIGURE 3 illustrates an altemate embodiment of the process shown in 

15 FIGURE 2. The steps shown in blocks 54, 56 and 58 are the same as that described 
above in FIGURE 2 at blocks 40, 42 and 44. After block 58, at decision block 60, the 
motion sampler and determiner component 22 determines if the value of change in 
video motion differs from one or more previously determined values by more than a 
threshold amount. If the most recently determined value of change in video motion 

20 does not differ by more than the threshold amount, the process returns to block 56 to 
take a sample of a successive frame, or of a frame at some interval in time or number 
of frames from the recently sampled frame. If the most recently determined value of 
change in video motion does differ by more that the threshold amount, at block 62, 

5 
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the I-frame interval determiner component 24 determines an I-frame interval 
according to the determined value of change in video motion. At block 64, the video 
compressor component 26 compresses the received video image according to the 
determined I-frame interval. The process then returns to block 56 to take a sample of 

5 a successive frame, or a frame at some interval in time or number of frames from the 
recently sampled frame. 

FIGURE 4 illustrates another embodiment of the process shown in 
FIGURE 2. The steps showoi in blocks 70, 72, 74 and 76 are the same as that 
described above in FIGURE 2 at blocks 40, 42, 44 and 46. After block 76, at 

10 decision block 78, the I-frame interval determiner component 24 determines if the 
determined I-frame interval differs from one or more previously determined intervals 
by more than an interval threshold amount. If the most recently determined interval 
does not differ by more than the interval threshold amount, the process returns to 
block 72 to take a sample of a successive frame, or a frame at some interval in time or 

15 number of frames from the recently sampled frame. If the most recently determined 
interval does differ by more that the interval threshold amount, at block 80, the video 
compressor component 26 compresses the received video image according to the 
most recently determined I-frame interval determination. The process then returns to 
block 72 to take a sample of a successive frame, or a frame at some interval in time or 

20 number of frames from the recently sampled fi^me. 

The steps described in FIGURES 2-4 may be performed in a multiple of 
different orders without depaning from the scope of the present invention. 
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While the preferred embodiment of the invention has been illustrated and 
described, many changes can be made without departing from the spirit and scope of 
the invention. Accordingly, the scope of the invention is not limited by the disclosure 
of the preferred embodiment. Instead, the invention should be detemiined entirely by 
5 reference to the claims that follow. 
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The embodiments of the invention in which an exclusive property or privilege is 
claimed are defined as follows: 

1. A method for automatically adjusting frame interval between frames 
5 of digital video during Cv-^mpression of a received video signal comprising: 

a) determining a video motion value from the video signal; 

b) determining frame interval according to the determined video motion 
value; and 

c) automatically adjusting the frame interval according to the determined 
10 frame interval. 

2. The method of Claim 1, wherein determining a video motion value 
comprises 

taking a sample of a frame of the video signal, 

comparing the sample to one or more previously taken frame samples, 

15 and 

determining the video motion value according to the comparison. 

3. The method of Claim 2, further comprising: 

repeating a-c for other fi^mes of the video signal in accordance with a 
predetermined sampling pattern. 
20 4. The method of Claim 3, wherein the sampling pattern is every frame 

of the video signal. 

5. The method of Claim 1, wherein determining frame interval fiirther 
comprises 
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comparing the determined video motion value to one or more 
previously determined video motion values, 

if the determined video motion value differs from the one or more 
previously determined video motion values by a threshold amount, determining frame 
5 interval according to the determined video motion value, and 

if the determined video motion value does not differ from the one or 
more previously determined video motion values by the threshold amount, returning 
to a. 

6. The method of Claim 1, wherein compression is performed in 
10 accordance with a MPEG compression scheme. 

7. A computer program product for performing the process of Claim 1 . 

8. A computer program product for performing the process of Claim 2. 

9. A computer program product for performing the process of Claim 3. 

10. A computer program product for performing the process of Claim 4, 
15 11. A computer program product for performing the process of Claim 5 . 

12. A computer program product for performing the process of Claim 6. 
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